Three-Dimensional Measurement: Apparatus and 
Three-Dimensional Measurement: Method 

5 CROSS REFERENCES TO RELATED APPLICATIONS 

The present invention claims priority to its priority 
document No, 2003-021359 filed in the Japanese Patent Office 
on January 30, 2003, the entire contents of which being 
incorporated by reference herein. 
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BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to a three-dimensional 
15 measurement apparatus and a three-dimensional measurement 
method for measuring a three-dimensional shape of an object to 
be measured by radiating and scanning the object with a laser 
beam and reading reflected light therefrom. 

20 2. Description of the Related Art 

One of currently available methods for obtaining 
three-dimensional profile information of an object is an 
optical sectioning method.. As shown in Fig. 7, slit light is 
projected to an object while scanning it, and reflected light 

25 therefrom is received by an image sensor of a camera. By 
measuring timings on which the reflected light is received per 
pixel, a distance from an imaging surface of the image sensor 
to an object to be measured is measured in accordance with the 
principle of triangulation (for example, refer to Japanese 

30 Patent application Laid-Open Publication No. 2001-280926, 
Japanese Patent Application Laid-Open Publication No. 
2001-108418) . 
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Typically, in the above-mentioned optical sectioning 
method, a typical CCD image sensor is employed for receiving 
light. In this case, the frame rate is limited to about 30 fps. 
5 If it is desirable to maintain a certain degree of distance 
resolution, a scanning rate has to be slowed down, thus making 
it difficult to use for real-time measuring of a moving object. 

In order to address the above point, a system that enables 
10 a high-speed measurement by improving an image sensor is 
disclosed in Japanese Patent Application No. 2001-287625 
(Japanese Patent Application Laid-Open Publication No. 
2003-169251, Published Date: June 13, 2003). 

15 In Fig. 6 of the above-mentioned Japanese Patent 

Application Laid-Open Publication No. 2003-16925, the 
principle of triangulation and the principle of 
three-dimensional measurement based on a laser slit light are 
described. 

20 

The above-mentioned system is designed for allowing each 
pixel to detect a passing timing of the slit light at a high 
speed by carrying out a differential calculation with a high 
frame rate inside the image sensor. In the above-mentioned 
25 system, it is possible to measure a distance image at 15 fps 
or 30 fps by means of carrying out the differential calculation 
by the image sensor at 3.3 kfps . 

SUMMARY OF THE INVENTION 

30 

However, a time period for receiving light in the 
above-mentioned image sensor is limited since the image sensor 
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operates based on the principle such that reflected light is 
detected by the high-speed frame operation. Accordingly, it 
is likely to require operations such as increasing intensity 
of the projected light or increasing sensitivity of a comparator 
5 circuit that carries out the differential calculation between 
frames if a distance to an object to be measured is, larger or 
an object to be measured has a poor reflection rate for the slit 
light . 

10 In such a case, applications thereof may be limited. For 

example, in utilization of such a system for measuring face 
profile data of a human being, the intensity of projected light 
is restricted in view of safety regarding intensity of light 
entering the human eyes. Further, if the sensitivity of the 

15 comparator circuit is increased, possibility of so-called false 
detections increases because the higher comparator circuit's 
sensitivity results the higher sensor sensitivity on a change 
of the light intensity and causes the image sensor to respond 
even to minute change in environment light. 

20 

Accordingly, in a real-time three-dimensional 
measurement system such as one described above, it is desirable 
to decrease output of light source in view of safety of the 
projected light or conservation of energy consumption. 

25 

Further, in such a system, it is desirable to provide a 
measure to facilitate discrimination between a change of the 
environment light and a change of light due to a passage of the 
projected light. 

30 

The present invention has been made to address the 
above-mentioned point. According to one embodiment of the 
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present invention, there is provided a three-dimensional 
measurement apparatus for measuring a three-dimensional shape 
of an object to be measured by irradiating and scanning the 
ob j ect with a laser light . The apparatus includes optical means 
5 for dividing the laser light into a plurality of beams with 
having a predetermined angle in between for the irradiation; 
and discriminating means for reading out and discriminating 
each of a plurality of reflected laser light beams, the 
plurality of the reflected laser light beams corresponding to 
10 the plurality of divided beams, respectively, the plurality of 
divided beams being used for the irradiation by the optical 
means . 

According to another embodiment of the present invention, 
15 there is provided a three-dimensional measurement method for 
measuring a three-dimensional shape of an object to be measured 
by irradiating and scanning the object with a laser light. The 
method includes the steps of dividing the laser light into a 
plurality of beams with having a predetermined angle in between 
20 for the irradiation, and reading out and discriminating each 
of a plurality of reflected laser light beams, the plurality 
of the reflected laser light beams corresponding to the 
plurality of divided beams, respectively, the plurality of 
divided beams being used for the irradiation. 

25 

In an embodiment of the present invention, a laser beam 
is divided into a plurality of beams with a predetermined angle 
in between. The plurality of beams are used for irradiating 
and scanning an object to be measured. A plurality of reflected 
30 light beams from the object are read and discriminated. An 
operation is performed to determine whether or not the read-out 
reflected light beams are detected with an interval 
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corresponding to the predetermined angle. If the interval 
between the read-out reflected light beams corresponds to the 
. predetermined angle, it is determined that the read-out 
reflected light beams are indeed beams of light reflected on 
5 the object to be measured, and a three-dimensional shape data 
is generated based on the read-out reflected light beams. If 
the interval between the reflected light beams does not 
correspond to the predetermined angle, it is determined that 
the read-out reflected light beams are caused by the light 
10 disturbance, and data based on the read-out reflected light 
beams is not used for generating the three-dimensional shape 
data . 



BRIEF DESCRIPTION OF THE DRAWINGS 

15 

These and other objects, features and advantages of the 
present invention will become more apparent in light of the 
following detailed description of a best mode embodiment 
thereof, as illustrated in the accompanying drawings: 
20 Fig. 1 is a diagram showing a concept of a 

three-dimensional measurement apparatus according to an 
embodiment of the present invention; 

Fig. 2 is a view, which is viewed from above, of a 
three-dimensional measurement apparatus according to the 
25 embodiment shown in Fig. 1; 

Fig. 3 is a diagram showing optical relation from a laser 
source to the vicinity of a scanning mirror; 

Fig. 4 is a block diagram explaining operation means; 

Fig. 5 is a diagram explaining another example of a 
30 hologram plate arrangement; 

Fig. 6 is a diagram explaining an example in which a laser 
source is turned with a hologram plate; and 



5 



Fig. 7 is a diagram explaining a three-dimensional 
measurement according to a conventional optical sectioning 
method . 

5 DETAILED DESCRIPTION OF THE EMBODIMENTS 

Below, embodiments of the present invention is will be 
described with reference to the drawings. 

10 Fig. 1 is a diagram showing a concept of a 

three-dimensional measurement apparatus of an embodiment 
according to the present invention. The three-dimensional 
measurement apparatus of the present embodiment includes a 
laser source 1 emitting a beam of laser light, a hologram plate 

15 2 that separates a beam of laser light 10 emitted from the laser 
source 1 into a plurality of light beams by a predetermined angle, 
and a scanning mirror 3 that reflects the plurality of laser 
light beams formed by the separation occurred in the hologram 
plate 2 and scans an object S to be measured with the plurality 

20 of laser light beams. 

The hologram plate 2 is capable of converting the laser 
light beam 10 emitted from the laser source 1 into any arbitrary 
pattern. In an example of the present embodiment, it is so 
25 arranged that the laser light beam 10 emitted from the laser 
source 1 may be divided into two line-shaped laser beams (slit 
light A and slit light B) with a predetermined angle in between. 

The scanning mirror 3 is so designed that it makes a 
30 oscillation movement within a predetermined angle and reflects 
the plurality of laser light beams from the hologram plate 2 
(slit light A and slit light B) toward the object S to be 
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measured. 

Fig. 2 is a view that is of the three-dimensional 
measurement apparatus of the present embodiment shown in Fig. 
5 1, which is viewed from the above. After the beam shaped light 
emitted from the laser source 1 passes through the hologram 
plate 2, the beam of light is converted into two slit-shaped 
beams of light with a certain constant separation angle. Then, 
as similar way as in a system based on a typical optical 
10 sectioning method, these slit-shaped beams of light is radiated 
to the object to be measured by the scanning mirror 3 which 
performs a scanning operation. 

In the present example, a sensor 4 detects reflected light 
15 of the slit-shaped light beams, and the two light beams, the 
slit light A and the slit light B, are subjected to sweeping 
operation with a constant angle all the time. Accordingly, at 
each pixel, the slit light B will be detected at a constant period 
of time or a constant number of frame operations after the 
20 detection of the slit light A providing that a speed of the 
scanning operation of the scanning mirror 3 is constant. The 
present embodiment is characterized by discriminating two beams 
of the slit light A and the slit light B so as to acquire an 
accurate three-dimensional shape. 

25 

In the related art techniques, the passage of single beam 
of the slit light is detected by measuring an optical intensity 
change in time (differential operation of signals between the 
frames) . Accordingly, the false detection may be caused due 
30 to the fact that it is difficult to determine if the detected 
light intensity change is caused by the real passage of the laser 
light or light disturbance occurred in its background 
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environment, thereby making it difficult to perform accurate 
three-dimensional measurement. 

On the other hand, according to the three-dimensional 
5 measurement apparatus according to the present embodiment, the 
passage of the slit light may be easily discriminated from the 
light disturbance in the background environment by making the 
slit light into two beams and detecting the passage of the slit 
light only if both beams of the slit light are detected with 
10 having a constant time period in between the detections of the 
two beams . 

A sensor disclosed in Japanese Patent Application No. 
2001-287625 (Japanese Patent Application Laid-Open Publication 

15 No. 2003-169251) is provided with a comparator to carry out 
differential operation between frames for detection of a 
passage of reflected laser light. In this related art, an 
offset bias is intentionally applied in between frames so as 
to prevent detections of weak light disturbance in background 

20 environment because a higher comparator sensitivity may 
increasb a possibility of detecting such weak light disturbance, 
thereby making it difficult to perform accurate 
three-dimensional measurements . 

25 However, such a offset biasing operation may also reduce 

the sensitivity for detecting changes of optical intensity 
caused by the reflected laser light, thereby making it difficult 
to carry out high-speed measurements or measurements by using 
a low-output light source . 

30 

In the present embodiment, by providing the two beams of 
the slit light, it is possible not only to eliminate the light 
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disturbance but also to preventing the false detection to be 
occurred. Accordingly, the offset bias may be either 
eliminated or considerably reduced, thus enabling to improve 
the sensitivity for detecting changes of the reflected laser 
5 light. 

Fig. 3 is a diagram showing an optical relation from the 
laser source to the periphery of the scanning mirror. A beam 
of light emitted from the laser source 1 is separated into two 
10 beams of the slit light A and the slit light B by an angle of 
Of after passing through the hologram plate 2, 

The slit light A and the slit light B are projected in 
such a manner that the centers of the slit light A and the slit 
15 light B match the center of rotation of the scanning mirror 3. 
Respective slit light (the slit light A and the slit light B) 
is reflected in accordance with an incident angle to the 
scanning mirror 3 and irradiates the object to be measured. 

20 An optical system of the slit light that is viewed from 

the object to be measured is equivalent to a case in which a 
light source is positioned at PI. It may be assumed that the 
two beams of the slit light are emitted from this point . Further, 
if the scanning mirror 3 rotates by the angle of Of, the position 

25 of such a light source moves- from the point PI to P2 . In this 
example, it is assumed that a beam direction of the slit light 
A for the assumed light source at the point PI matches a beam 
direction of the slit light B for the point P2 . 

30 Accordingly, a pixel of the sensor that has detected the 

passage of the slit A at a time corresponding to the point PI 
will detect the slit light B at a time corresponding to the point 
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P2 . This relationship holds any arbitrary angle of the scanning 
mirror. Each pixel of the sensor detects the slit light B 
subsequent to the rotation of the scanning mirror 3 by the angle 
of 9f after detecting the slit light A. 

5 

The light path of the slit light A at the time of PI and 
the light path of the slit light B at the time of P2 are not 
in complete agreement. There is a light path discrepancy Al 
for an amount of a parallel shift. However, these light paths 
10 may be considered to be in agreement if they are viewed from 
each pixel of the sensor because it may be assumed that the ob j ect 
to be measured is located at sufficiently distant position with 
respect to AL. 

15 The present embodiment will be described more in detail 

with an example that uses specific numeric values. In the 
present example, a distance Ad from the hologram plate to the 
mirror is set to approximately 4 mm, and an angle of separation 
between the two beams of the slit light is approximately 0f=2°. 

20 Under this setting, a separation width of the two beams of the 
slit light on the scanning mirror is 0.14 mm, and the separation 
width becomes about 3.5 cm on the irradiated object that is to 
be measured if the object is located 1 m from the scanning mirror 
3. Further, the light path discrepancy AL is AL=0.16 mm 

25 (AL= (2*ADsin (6f /2) ) /cos (6m) ) , where an angle of oscillation 
6m=30°. This value of AL is a sufficiently small value if a 
laser spot diameter of some 2-3 mm is taken into consideration. 

Further, if it is assumed that the scanning operation of 
30 the scanning mirror 3 is carried out with a speed of 15 Hz over 
a range of an oscillation angle of 60°, and the sensor is operated 
with 1 . 6k frame/ s, the sensor performs approximately 10 6 frames 

10 



operations in single scan. In other words, it is possible to 
perform the detection operation of reflected light in 106 
divisions. This is equivalent to dividing the angle of mirror 
oscillation into angles of 0.57°. Accordingly, in a case where 
5 the angle of separation of two beams of the slit light is 2°, 
each pixel detects the slit light B approximately 4 frames after 
the detection of the slit light A. 

In a sensor disclosed in Patent Application No. 2001- 
10 287625 (Japanese Patent Application Laid-Open Publication No. 
2003-169251) , it is so designed that upon detecting the passage 
of the slit light, each pixel outputs data 1 while outputting 
data 0 in other cases. If such a sensor detects the slit light 
A and the slit light B, a pixel would output a data pattern of 
15 "10001" for five consecutive frame operations. 

The above-mentioned settings relate to an ideal case, and 
setting for embodiments of the present invention are not limited 
to the above-mentioned settings. For example, setting the 
20 centers of two beams of the slit light to the center of rotation 
of the mirror or setting the rate of rotation of the mirror 
constant may not be required as long as a system, to which the 
present invention is applied, can tolerate possible errors 
caused by not having such settings as a whole. 

25 

Next, referring to the block diagram of Fig. 4, operation 
means for the reflected light upon receipt thereof will be 
described. Namely, an imaging signal and a three-dimensional 
measurement signal are respectively outputted from separate 
30 output sections of a sensor 4. Of these signals, the imaging 
signal is inputted to an imaging signal processor 51 in a similar 
way to a case of typical CMOS image sensor for conversion to 
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image information (imaging signal data) . 



On the other hand, the three-dimensional measurement 
signal is inputted to a three-dimensional measurement section 
5 (discriminating means) 52 which is connected to a frame memory 
53 for data storage and a frame counter 54 for counting the number 
of frames. The output from the sensor 4 outputs in sequence 
information indicating if the reflected laser light is detected 
in every pixels per frame. 

10 

In this embodiment, it is assumed that "1" corresponds 
to data of a pixel in which the reflected laser light is detected, 
"0" corresponds to data of a pixel in which the reflected laser 
light is not detected, and an interval period between the slit 
15 light A and the slit light B is 4 frames. 

Further, the frame memory 53 has a 5-bit data area for 
each pixel for memorizing detection/non-detection of the 
reflected laser light per frame, a 3-bit memory area for data 
20 count values specifying a write position of the 5-bit data area, 
and a 7-bit memory area for memorizing the number of frame 
counts . 

A frame counter 54 starts its counting in synchronization 
25 with a start of the scanning of the scanning mirror. In the 
example described above, the frame operation in the sensor 4 
is carried out 106 times during single scanning operation. A 
frame count value obtained when two beams of the slit light are 
confirmed is stored in the 7-bit memory area. Accordingly, the 
30 entire memory has a capacity sufficient to store data of the 
total number of pixels x 15 bits. 
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The reflected laser light detection data from the sensor 
4 is sequentially read-out and sent to the three-dimensional 
measurement signal processor 52. At the same time, the 3-bit 
data count value corresponding to each pixel is read from the 
5 frame memory 53. With this data, the three-dimensional 
measurement signal processor 52 first determines whether or not 
the pixel is a pixel which has detected the laser slit light. 

If the pixel is a pixel that has not detected the laser 
10 slit light, the data count is "000". If once the leading slit 
light A is detected, the number of frames thereafter is counted. 
If the pixel is in the undetected status, data from the sensor 
is read. If the data is "1", "1" is set at the leading bit of 
the frame data, and a further the data count value is set to 
15 "001". 

On the other hand, if data from the sensor is "0", it means 
that the slit light has not been detected. Accordingly, no 
write operation into the frame memory 53 is performed, and the 
20 process directly proceeds to the next operation. 

Further, in the next frame operation after the pixel's 
detection of the slit light, data thereafter is checked because 
"001" is set for the data count value by the above-mentioned 
25 operation. In the checking operation, first, data from the 
sensor is determined as the second data. Dl . If the data is "0", 
it is written in the Dl area of the frame data as a correct data 
sequence and the data count value is changed to "010". 

30 The similar operation is continued up to the fifth bit 

(D4) of the frame data. It is concluded that the pixel has 
detected the laser beam only if all the data up to. the fifth 
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bit respectively matches the initial laser pattern "10001". 
The 7-bit frame count value at a time of the conclusion is stored 
in the frame count data area. 

5 In other words, by holding the laser pattern "10001" as 

a template data and comparing it with the data up to the fifth 
bit, the detection of the reflected laser light from the object 
to be measured is confirmed if these data are in agreement. If 
these data are not in agreement, such data is construed as the 
10 light disturbance and removed from measurement operations. 

Subsequently, upon completing single mirror scanning 
operation, the frame count data of each pixel is read out to 
outside the system. Each of the frame count values corresponds 
15 to a specific value of the mirror scanning angle, and to a 
distance from the sensor to the object. 

Accordingly, in outside of the system, actual distance 
data may be obtained by subtracting pre-calibrated count data 
20 for a reference plane from the measured count data and 
performing a distance conversion operation. 

The above-mentioned operation makes it easy to 
discriminate the light disturbance noise from the reflected 
25 laser light. For example, even if data "1" is obtained as a 
result of the light disturbance and no reflected laser light 
is measured, the possibility of having data "0001" thereafter 
is extremely low assuming that the light disturbance noise 
occurs random in time. 

30 

In the above-mentioned embodiment, the two beams of the 
slit light are employed. In an environment where intense 
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changes of background light is expected, the data , pattern 
mentioned above ( for example, "10001") may occur by pure chance. 
In that case, the number of beams of slit light may be increased 
to three or more so as to provide a sharper distinction from 
5 a possible data pattern due to the environment light. Further, 
the light pro j ection pattern may not need to have the slit shape . 
Alternatively, any arbitrary projection pattern may be employed 
as long as a plurality of points of such a pattern are made 
available to confirm the detection of the reflected light. 

10 

Still further, in the above-mentioned embodiment, the 
fixed data pattern is used for discriminating the light 
disturbance from the actual reflected light. However, in an 
actual system, it is possible to have some errors in timing due 

15 to a change or deviation in the rotational speed of the scanning 
mirror. To counter measure such errors, it is possible to have 
settings which incorporate redundancy. In other words, it is 
not necessary to limit the slit light detection pattern 
(template data) to single type, and a plurality of the patterns 

20 such as "10001" or "10010" may be used. The detection of the 
reflected laser light may be determined if any one of the 
patterns are in agreement. 

Furthermore, in Fig. 3, the hologram plate 2 is placed 
25 between the laser source 1 and the scanning mirror 3. 
Alternatively, as shown in Fig. 5, the hologram plate 2 may be 
placed in a subsequent stage following the scanning mirror 3. 
In a case where an apparatus is so constructed that the laser 
source 1 and the scanning mirror 3 are integrally built, an 
30 optical means according to an embodiment of the present 
invention may be simply realized by attaching the hologram plate 
2 at an emission opening of laser light from the scanning mirror. 



The emission opening may be formed on a casing of the apparatus. 
Further, according to the structure described above, it is 
possible to make the optical means smaller by narrowing a 
spacing between the laser source 1 and the scanning mirror 3. 

Alternatively, an embodiment of the present invention may 
be realized without employing the scanning mirror 3. For 
example, as shown in Fig. 6, the hologram plate 2 and the laser 
source 1 may be arranged so as to rotate together. If the 
hologram plate 2 is set at the center of rotation, the light 
path discrepancy Al mentioned above may be made zero in 
principle. Further, a different arrangement for the center of 
rotation may be possible as long as errors due to the different 
arrangement is tolerable. For example, the laser light source 
may be set at the center of rotation. 

A three-dimensional measurement apparatus according to 
the present invention may be applicable in the fields of, for 
example, game creation, game apparatuses, personal computers, 
20 robotics, security systems, vehicle on-board apparatuses and 
moving image communication. The personal computer 

applications may include three-dimensional (stereoscopic) 
modeling, gesture recognition, and user inter face. The 
robotics applications' may include obstacle detection, object 
25 recognition, facial recognition (background deletion) , 
gesture recognition and user interface. The security 
applications may include facial recognition, personal feature 
recognition and detection of intruding object. The vehicle 
on-board applications may include obstacle detection, 
30 passenger detection, video phone and TV conferencing. The 
moving image communication application may include background 
extraction. 
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As described above, according to the embodiments of the 
present invention, there are the following advantages. An 
embodiment of the present invention allows an accurate 
distinction between the reflected light and the disturbance 
light by irradiating the object to be measured with a plurality 
of beams while scanning and measuring reflected light from the 
object- Further, an embodiment of the present invention allows 
to separate the disturbance light during the reflected light 
detection even if a small intensity of projected laser light 
is used, thereby enabling realization of a real-time 
three-dimensional measurement. 

Although the present invention has been shown and 
described with respect to a best mode embodiment thereof, it 
should be understood by those skilled in the art that the 
foregoing and various other changes, omissions, and additions 
in the form and detail thereof may be made therein without 
departing from the spirit and scope of the present invention. 
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